An evaluation of computational methods for aggregate data meta-analyses of diagnostic test accuracy studies.

BACKGROUND: A Generalized Linear Mixed Model (GLMM) is recommended to meta-analyze diagnostic test accuracy studies (DTAs) based on aggregate or individual participant data. Since a GLMM does not have a closed-form likelihood function or parameter solutions, computational methods are conventionally used to approximate the likelihoods and obtain parameter estimates. The most commonly used computational methods are the Iteratively Reweighted Least Squares (IRLS), the Laplace approximation (LA), and the Adaptive Gauss-Hermite quadrature (AGHQ). Despite being widely used, it has not been clear how these computational methods compare and perform in the context of an aggregate data meta-analysis (ADMA) of DTAs. METHODS: We compared and evaluated the performance of three commonly used computational methods for GLMM - the IRLS, the LA, and the AGHQ, via a comprehensive simulation study and real-life data examples, in the context of an ADMA of DTAs. By varying several parameters in our simulations, we assessed the performance of the three methods in terms of bias, root mean squared error, confidence interval (CI) width, coverage of the 95% CI, convergence rate, and computational speed. RESULTS: For most of the scenarios, especially when the meta-analytic data were not sparse (i.e., there were no or negligible studies with perfect diagnosis), the three computational methods were comparable for the estimation of sensitivity and specificity. However, the LA had the largest bias and root mean squared error for pooled sensitivity and specificity when the meta-analytic data were sparse. Moreover, the AGHQ took a longer computational time to converge relative to the other two methods, although it had the best convergence rate. CONCLUSIONS: We recommend practitioners and researchers carefully choose an appropriate computational algorithm when fitting a GLMM to an ADMA of DTAs. We do not recommend the LA for sparse meta-analytic data sets. However, either the AGHQ or the IRLS can be used regardless of the characteristics of the meta-analytic data.

Comparison of malaria diagnostic methods for detection of asymptomatic Plasmodium infections among pregnant women in northwest Ethiopia.

BACKGROUND: Malaria in pregnancy remains a major public health problem in the globe, especially in sub-Saharan Africa. In malaria endemic areas, most pregnant women remain asymptomatic, but malaria could still cause complications on the mother and her offspring; as well as serve as reservoirs to transmit infection. Despite these effects, no attention is given to the diagnosis of asymptomatic Plasmodium infections (APIs) using highly sensitive and specific laboratory diagnostic tools in Ethiopia. Therefore, the goal of this study was to compare the performance of Rapid Diagnostic Test (RDT), microscopy and real-time polymerase chain reaction (RT-PCR) to detect APIs among pregnant women. METHODS: A health facility based cross -sectional study was conducted among pregnant women attending antenatal care at Fendeka town health facilities Jawi district, northwest Ethiopia from February to March, 2019. A total of 166 participants were enrolled by using convenient sampling technique. Socio-demographic features were collected using a semi structured questionnaire. Dried blood spot (DBS) samples were collected for molecular analysis. Asymptomatic Plasmodium infection on pregnant women was diagnosed using RDT, microscopy and RT-PCR. Descriptive statistics were used to determine the prevalence of APIs. Method comparison was performed, and Cohen's kappa coefficient (k) was used to determine the degree of agreement among the diagnostic methods. Parasite densities were also calculated. RESULTS: The prevalence of API was 9.6%, 11.4% and 18.7% using RDT, microscopy and RT-PCR, respectively. The overall proportion of API was 19.3%. Sensitivity of the RDT was 83.3% as compared with microscopy. Rapid Diagnostic Test and microscopy also showed sensitivity of 50% and 60%, respectively, as compared with RT-PCR. The mean parasite density was 3213 parasites/µl for P falciparum and 1140 parasites/µl of blood for P. vivax. CONCLUSION: Prevalence of API in the study area was high. Both RDT and microscopy had lower sensitivity when compared with RT-PCR. Therefore, routine laboratory diagnosis of API among pregnant women should be given attention and done with better sensitive and specific laboratory diagnostic tools.

Comparative evaluation of the diagnostic accuracies of four different malaria rapid diagnostic test kits available in Ghana.

Malaria rapid diagnostic test (mRDT) kit is one of the techniques for diagnosing malaria. Due to its inherent advantages over the microscopy technique, several brands of the kit have flooded malaria endemic countries, without prior in-country evaluation. Two of such mRDT kits are Oscar (India) and Standard Q (Korea Republic). In this study, the performance of Oscar and Standard Q mRDT kits were compared to First Response (India) and CareStart (USA) mRDTs, which have been evaluated and deployed for use approved by the Ministry of Health (MOH). In this comparative study, whole blood samples were collected from patients suspected of malaria. Plasmodium falciparum was detected in each sample using nested polymerase chain reaction (nPCR), microscopy and the four mRDTs. The sensitivities, specificities, accuracies, positive and negative predictive values and accuracies of the mRDTs were determined using nPCR as a reference technique. Kappa statistic was used to determine the level of agreement among the techniques. Two hundred (200) blood samples were analyzed in this study. The overall detection rates of P. falciparum by microscopy, First Response, CareStart, Oscar-PfHRP2, Standard Q mRDT kits and nPCR were 31.5%, 34.5%, 33.5%, 32%, 31% and 43% (x2 = 6.1, p = 0.046), respectively. The accuracies of CareStart and First Response were comparable (90.5% vs. 89.5%). Further, comparing their sensitivities, Oscar-PfHRP2 was 74.4% (95% confidence interval (CI): 63.9-83.2) while that of Standard Q was 72.1% (95% CI: 61.4-81.2), with comparable accuracies (Oscar-PfHRP2-89% and Standard Q -88%). Apart from First Response that was 98.3% specific, the others were 100% specific. Kappa test revealed perfect diagnostic agreement (κ = 0.90-0.98) among the four mRDTs. That notwithstanding, Oscar-PfHRP2 agreed better with CareStart (κ = 0.94) and First Response (κ = 0.92) compared to the agreement between Standard Q and, CareStart (κ = 0.92) and First Response (κ = 0.90). Taken together, the diagnostic performance of the four mRDT kits were statistically similar. That notwithstanding, new mRDT kits should be evaluated prior to deployment for use.

Rapid diagnostic test: a critical need for outbreak preparedness and response for high priority pathogens.

Rapid diagnostic tests (RDTs) are critical for preparedness and response against an outbreak or pandemic and have been highlighted in the 100 Days Mission, a global initiative that aims to prepare the world for the next epidemic/pandemic by driving the development of diagnostics, vaccines and therapeutics within 100 days of recognition of a novel Disease X threat.RDTs play a pivotal role in early case identification, surveillance and case management, and are critical for initiating deployment of vaccine and monoclonal antibodies. Currently available RDTs, however, have limited clinical sensitivity and specificity and inadequate validation. The development, validation and implementation of RDTs require adequate and sustained financing from both public and private sources. While the World Health Assembly recently passed a resolution on diagnostic capacity strengthening that urges individual Member States to commit resources towards this, the resolution is not binding and implementation will likely be impeded by limited financial resources and other competing priorities, particularly in low-income countries. Meanwhile, the diagnostic industry has not sufficiently invested in RDT development for high priority pathogens.Currently, vaccine development projects are getting the largest funding support among medical countermeasures. Yet vaccines are insufficient tools in isolation, and pandemic preparedness will be incomplete without parallel investment in diagnostics and therapeutics.The Pandemic Fund, a global financing mechanism recently established for strengthening pandemic prevention, preparedness and response, may be a future avenue for supporting diagnostic development.In this paper, we discuss why RDTs are critical for preparedness and response. We also discuss RDT investment challenges and reflect on the way forward.

Diagnostic accuracy of DPP Fever Panel II Asia tests for tropical fever diagnosis.

BACKGROUND: Fever is the most frequent symptom in patients seeking care in South and Southeast Asia. The introduction of rapid diagnostic tests (RDTs) for malaria continues to drive patient management and care. Malaria-negative cases are commonly treated with antibiotics without confirmation of bacteraemia. Conventional laboratory tests for differential diagnosis require skilled staff and appropriate access to healthcare facilities. In addition, introducing single-disease RDTs instead of conventional laboratory tests remains costly. To overcome some of the delivery challenges of multiple separate tests, a multiplexed RDT with the capacity to diagnose a diverse range of tropical fevers would be a cost-effective solution. In this study, a multiplex lateral flow immunoassay (DPP Fever Panel II Assay) that can detect serum immunoglobulin M (IgM) and specific microbial antigens of common fever agents in Asia (Orientia tsutsugamushi, Rickettsia typhi, Leptospira spp., Burkholderia pseudomallei, Dengue virus, Chikungunya virus, and Zika virus), was evaluated. METHODOLOGY/PRINCIPAL FINDINGS: Whole blood (WB) and serum samples from 300 patients with undefined febrile illness (UFI) recruited in Vientiane, Laos PDR were tested using the DPP Fever Panel II, which consists of an Antibody panel and Antigen panel. To compare reader performance, results were recorded using two DPP readers, DPP Micro Reader (Micro Reader 1) and DPP Micro Reader Next Generation (Micro Reader 2). WB and serum samples were run on the same fever panel and read on both micro readers in order to compare results. ROC analysis and equal variance analysis were performed to inform the diagnostic validity of the test compared against the respective reference standards of each fever agent (S1 Table). Overall better AUC values were observed in whole blood results. No significant difference in AUC performance was observed when comparing whole blood and serum sample testing, except for when testing for R. typhi IgM (p = 0.04), Leptospira IgM (p = 0.02), and Dengue IgG (p = 0.03). Linear regression depicted R2 values had ~70% agreement across WB and serum samples, except when testing for leptospirosis and Zika, where the R2 values were 0.37 and 0.47, respectively. No significant difference was observed between the performance of Micro Reader 1 and Micro Reader 2, except when testing for the following pathogens: Zika IgM, Zika IgG, and B pseudomallei CPS Ag. CONCLUSIONS/SIGNIFICANCE: These results demonstrate that the diagnostic accuracy of the DPP Fever Panel II is comparable to that of commonly used RDTs. The optimal cut-off would depend on the use of the test and the desired sensitivity and specificity. Further studies are required to authenticate the use of these cut-offs in other endemic regions. This multiplex RDT offers diagnostic benefits in areas with limited access to healthcare and has the potential to improve field testing capacities. This could improve tropical fever management and reduce the public health burden in endemic low-resource areas.

A qualitative study on determinants of the use of malaria rapid diagnostic test and anti-malarial drug prescription practices by primary healthcare workers in Ebonyi state, Nigeria.

BACKGROUND: The increased availability and use of malaria rapid diagnostic test (RDT) by primary healthcare (PHC) workers has made universal diagnostic testing before malaria treatment more feasible. However, to meaningfully resolve the problem of over-treatment with artemisinin-based combination therapy and the heightened risk of selection pressure and drug resistance, there should be appropriate response (non-prescription of anti-malarial drugs) following a negative RDT result by PHC workers. This study explored the determinants of the use of RDT and anti-malarial drug prescription practices by PHC workers in Ebonyi state, Nigeria. METHODS: Between March 2 and 10, 2020, three focus group discussions were conducted in English with 23 purposively-selected consenting PHC workers involved in the diagnosis and treatment of malaria. Data was analysed thematically as informed by the method by Braun and Clarke. RESULTS: The determinants of the use of RDT for malaria diagnosis were systemic (RDT availability and patient load), provider related (confidence in RDT and the desire to make correct diagnosis, PHC worker's knowledge and training, and fear to prick a patient), client related (fear of needle prick and refusal to receive RDT, and self-diagnosis of malaria, based on symptoms, and insistence on not receiving RDT), and RDT-related (the ease of conducting and interpreting RDT). The determinants of anti-malarial drug prescription practices were systemic (drug availability and cost) and drug related (effectiveness and side-effects of the drugs). The determinants of the prescription of anti-malarial drugs following negative RDT were provider related (the desire to make more money and limited confidence in RDT) and clients' demand while unnecessary co-prescription of antibiotics with anti-malarial drugs following positive RDT was determined by the desire to make more money. CONCLUSIONS: This evidence highlights many systemic, provider, client, and RDT/drug related determinants of PHC workers' use of RDT and anti-malarial drug prescription practices that should provide tailored guidance for relevant health policy actions in Ebonyi state, Nigeria, and similar settings.

On repeated diagnostic testing in screening for a medical condition: How often should the diagnostic test be repeated?

In screening large populations a diagnostic test is frequently used repeatedly. An example is screening for bowel cancer using the fecal occult blood test (FOBT) on several occasions such as at 3 or 6 days. The question that is addressed here is how often should we repeat a diagnostic test when screening for a specific medical condition. Sensitivity is often used as a performance measure of a diagnostic test and is considered here for the individual application of the diagnostic test as well as for the overall screening procedure. The latter can involve an increasingly large number of repeated applications, but how many are sufficient? We demonstrate the issues involved in answering this question using real data on bowel cancer at St Vincents Hospital in Sydney. As data are only available for those testing positive at least once, an appropriate modeling technique is developed on the basis of the zero-truncated binomial distribution which allows for population heterogeneity. The latter is modeled using discrete nonparametric maximum likelihood. If we wish to achieve an overall sensitivity of 90%, the FOBT should be repeated for 2 weeks instead of the 1 week that was used at the time of the survey. A simulation study also shows consistency in the sense that bias and standard deviation for the estimated sensitivity decrease with an increasing number of repeated occasions as well as with increasing sample size.

Fidelity of implementation of national guidelines on malaria diagnosis for children under-five years in Rivers State, Nigeria.

BACKGROUND: Malaria is still a disease of global public health importance and children under-five years of age are the most vulnerable to the disease. Nigeria adopted the "test and treat" strategy in the national malaria guidelines as one of the ways to control malaria transmission. The level of adherence to the guidelines is an important indicator for the success or failure of the country's roadmap to malaria elimination by 2030. This study aimed to assess the fidelity of implementation of the national guidelines on malaria diagnosis for children under-five years and examine its associated moderating factors in health care facilities in Rivers State, Nigeria. METHODS: This was a descriptive, cross-sectional study conducted in Port Harcourt metropolis. Data were collected from 147 public, formal private and informal private health care facilities. The study used a questionnaire developed based on Carroll's Conceptual Framework for Implementation Fidelity. Frequency, mean and median scores for implementation fidelity and its associated factors were calculated. Associations between fidelity and the measured predictors were examined using Mann Whitney U test, Kruskal Wallis test, and multiple linear regression modelling using robust estimation of errors. Regression results are presented in adjusted coefficient (ß) and 95% confidence intervals. RESULTS: The median (IQR) score fidelity score for all participants was 65% (43.3, 85). Informal private facilities (proprietary patent medicine vendors) had the lowest fidelity scores (47%) compared to formal private (69%) and public health facilities (79%). Intervention complexity had a statistically significant inverse relationship to implementation fidelity (ß = - 1.89 [- 3.42, - 0.34]). Increase in participant responsiveness (ß = 8.57 [4.83, 12.32]) and the type of malaria test offered at the facility (e.g., RDT vs. no test, ß = 16.90 [6.78, 27.03]; microscopy vs. no test, ß = 21.88 [13.60, 30.16]) were positively associated with fidelity score. CONCLUSIONS: This study showed that core elements of the "test and treat" strategy, such as testing all suspected cases with approved diagnostic methods before treatment, are still not fully implemented by health facilities. There is a need for strategies to increase fidelity, especially in the informal private health sector, for malaria elimination programme outcomes to be achieved.

Plasmodium falciparum pfhrp2 and pfhrp3 gene deletions among patients enrolled at 100 health facilities throughout Tanzania: February to July 2021.

Plasmodium falciparum with the histidine rich protein 2 gene (pfhrp2) deleted from its genome can escape diagnosis by HRP2-based rapid diagnostic tests (HRP2-RDTs). The World Health Organization (WHO) recommends switching to a non-HRP2 RDT for P. falciparum clinical case diagnosis when pfhrp2 deletion prevalence causes ≥ 5% of RDTs to return false negative results. Tanzania is a country of heterogenous P. falciparum transmission, with some regions approaching elimination and others at varying levels of control. In concordance with the current recommended WHO pfhrp2 deletion surveillance strategy, 100 health facilities encompassing 10 regions of Tanzania enrolled malaria-suspected patients between February and July 2021. Of 7863 persons of all ages enrolled and providing RDT result and blood sample, 3777 (48.0%) were positive by the national RDT testing for Plasmodium lactate dehydrogenase (pLDH) and/or HRP2. A second RDT testing specifically for the P. falciparum LDH (Pf-pLDH) antigen found 95 persons (2.5% of all RDT positives) were positive, though negative by the national RDT for HRP2, and were selected for pfhrp2 and pfhrp3 (pfhrp2/3) genotyping. Multiplex antigen detection by laboratory bead assay found 135/7847 (1.7%) of all blood samples positive for Plasmodium antigens but very low or no HRP2, and these were selected for genotyping as well. Of the samples selected for genotyping based on RDT or laboratory multiplex result, 158 were P. falciparum DNA positive, and 140 had sufficient DNA to be genotyped for pfhrp2/3. Most of these (125/140) were found to be pfhrp2+/pfhrp3+, with smaller numbers deleted for only pfhrp2 (n = 9) or only pfhrp3 (n = 6). No dual pfhrp2/3 deleted parasites were observed. This survey found that parasites with these gene deletions are rare in Tanzania, and estimated that 0.24% (95% confidence interval: 0.08% to 0.39%) of false-negative HRP2-RDTs for symptomatic persons were due to pfhrp2 deletions in this 2021 Tanzania survey. These data provide evidence for HRP2-based diagnostics as currently accurate for P. falciparum diagnosis in Tanzania.

Optimisation and evaluation of viral genomic sequencing of SARS-CoV-2 rapid diagnostic tests: a laboratory and cohort-based study.

BACKGROUND: Sequencing of SARS-CoV-2 from rapid diagnostic tests (RDTs) can bolster viral genomic surveillance efforts; however, approaches to maximise and standardise pathogen genome recovery from RDTs remain underdeveloped. We aimed to systematically optimise the elution of genetic material from RDT components and to evaluate the efficacy of RDT sequencing for outbreak investigation. METHODS: In this laboratory and cohort-based study we seeded RDTs with inactivated SARS-CoV-2 to optimise the elution of genomic material from RDT lateral flow strips. We measured the effect of changes in buffer type, time in buffer, and rotation on PCR cycle threshold (Ct) value. We recruited individuals older than 18 years residing in the greater Boston area, MA, USA, from July 18 to Nov 5, 2022, via email advertising to students and staff at Harvard University, MA, USA, and via broad social media advertising. All individuals recruited were within 5 days of a positive diagnostic test for SARS-CoV-2; no other relevant exclusion criteria were applied. Each individual completed two RDTs and one PCR swab. On Dec 29, 2022, we also collected RDTs from a convenience sample of individuals who were positive for SARS-CoV-2 and associated with an outbreak at a senior housing facility in MA, USA. We extracted all returned PCR swabs and RDT components (ie, swab, strip, or buffer); samples with a Ct of less than 40 were subject to amplicon sequencing. We compared the efficacy of elution and sequencing across RDT brands and components and used RDT-derived sequences to infer transmission links within the outbreak at the senior housing facility. We conducted metagenomic sequencing of negative RDTs from symptomatic individuals living in the senior housing facility. FINDINGS: Neither elution duration of greater than 10 min nor rotation during elution impacted viral titres. Elution in Buffer AVL (Ct=31·4) and Tris-EDTA Buffer (Ct=30·8) were equivalent (p=0·34); AVL outperformed elution in lysis buffer and 50% lysis buffer (Ct=40·0, p=0·0029 for both) as well as Universal Viral Transport Medium (Ct=36·7, p=0·079). Performance of RDT strips was poorer than that of matched PCR swabs (mean Ct difference 10·2 [SD 4·3], p<0·0001); however, RDT swabs performed similarly to PCR swabs (mean Ct difference 4·1 [5·2], p=0·055). No RDT brand significantly outperformed another. Across sample types, viral load predicted the viral genome assembly length. We assembled greater than 80% complete genomes from 12 of 17 RDT-derived swabs, three of 18 strips, and four of 11 residual buffers. We generated outbreak-associated SARS-CoV-2 genomes using both amplicon and metagenomic sequencing and identified multiple introductions of the virus that resulted in downstream transmission. INTERPRETATION: RDT-derived swabs are a reasonable alternative to PCR swabs for viral genomic surveillance and outbreak investigation. RDT-derived lateral flow strips yield accurate, but significantly fewer, viral reads than matched PCR swabs. Metagenomic sequencing of negative RDTs can identify viruses that might underlie patient symptoms. FUNDING: The National Science Foundation, the Hertz Foundation, the National Institute of General Medical Sciences, Harvard Medical School, the Howard Hughes Medical Institute, the US Centers for Disease Control and Prevention, the Broad Institute and the National Institute of Allergy and Infectious Diseases.

Potential Impact of a Diagnostic Test for Detecting Prepatent Guinea Worm Infections in Dogs.

Chad has seen a considerable reduction in cases of Guinea worm disease (or dracunculiasis) in domestic dogs in recent years. Tethering of dogs and application of Abate® larvicide to water sources appear to have contributed to this progress, but with 767 reported dog cases in 2021, accelerating elimination of the disease in Chad may require additional tools. We investigate the potential benefits of a hypothetical diagnostic test that could be capable of detecting prepatent infections in dogs. We adapt an agent-based simulation model for forecasting the impact of interventions on guinea worm disease in dogs to examine the interaction of multiple test factors including test accuracy, when the test can detect infection, dog selection, and dog-owner compliance with tethering recommendations. We find that a diagnostic test could be successful if used in conjunction with existing interventions, and elimination can be achieved within 2 years with 80% or higher test sensitivity, 90% or higher specificity, systematic testing of each dog twice per year, and more than 90% long-term tethering compliance when a dog tests positive or a worm is emerging. Because of the long incubation period of Guinea worm disease (10-14 months) and the fact that no treatment exists, the benefits of the test rely on the testing rollout and response of dog owners. If the test could estimate the timing of worm emergence, long-term tethering could be eliminated and infected dogs could be tethered only when the worms are expected, minimizing the related resources (human and financial) to support the intervention.

Unexpected severe malaria in a postoperative patient, New York, USA.

Severe malaria is not routinely considered when evaluating a febrile patient in the postoperative setting. Common bacterial infections, along with adverse drug reactions, are the usual differential concerns. We present a case of severe malaria emerging unexpectedly eight days after routine craniotomy.

Widespread pfhrp2/3 deletions and HRP2-based false-negative results in southern Ethiopia.

BACKGROUND: Rapid diagnostic tests (RDTs) play a significant role in expanding case management in peripheral healthcare systems. Histidine-rich protein-2 (HRP2) antigen detection RDTs are predominantly used to diagnose Plasmodium falciparum infection. However, the evolution and spread of P. falciparum parasite strains with deleted hrp2/3 genes, causing false-negative results, have been reported. This study assessed the diagnostic performance of HRP2-detecting RDTs for P. falciparum cases and the prevalence of pfhrp2/3 deletions among symptomatic patients seeking malaria diagnosis at selected health facilities in southern Ethiopia. METHODS: A multi-health facilities-based cross-sectional study was conducted on self-presenting febrile patients seeking treatment in southern Ethiopia from July to September 2022. A purposive sampling strategy was used to enroll patients with microscopically confirmed P. falciparum infections. A capillary blood sample was obtained to prepare a blood film for microscopy and a RDT using the SD Bioline™ Malaria Pf/Pv Test. Dried blood spot samples were collected for further molecular analysis. DNA was extracted using gene aid kits and amplification was performed using nested PCR assay. Exon 2 of hrp2 and hrp3, which are the main protein-coding regions, was used to confirm its deletion. The diagnostic performance of RDT was evaluated using PCR as the gold standard test for P. falciparum infections. RESULTS: Of 279 P. falciparum PCR-confirmed samples, 249 (89.2%) had successful msp-2 amplification, which was then genotyped for hrp2/3 gene deletions. The study revealed that pfhrp2/3 deletions were common in all health centres, and it was estimated that 144 patients (57.8%) across all health facilities had pfhrp2/3 deletions, leading to false-negative PfHRP2 RDT results. Deletions spanning exon 2 of hrp2, exon 2 of hrp3, and double deletions (hrp2/3) accounted for 68 (27.3%), 76 (30.5%), and 33 (13.2%) of cases, respectively. The study findings revealed the prevalence of P. falciparum parasites lacking a single pfhrp2-/3-gene and that both genes varied across the study sites. This study also showed that the sensitivity of the SD Bioline PfHRP2-RDT test was 76.5% when PCR was used as the reference test. CONCLUSION: This study confirmed the existence of widespread pfhrp2/3- gene deletions, and their magnitude exceeded the WHO-recommended threshold (> 5%). False-negative RDT results resulting from deletions in Pfhrp2/3- affect a country's attempts at malaria control and elimination. Therefore, the adoption of non-HRP2-based RDTs as an alternative measure is required to avoid the consequences associated with the continued use of HRP-2-based RDTs, in the study area in particular and in Ethiopia in general.

The deimplementation of laboratory testing in low-risk patients as recommended by the American society of anesthesiologists: An ACS-NSQIP longitudinal analysis.

BACKGROUND: In 2012, the American Society of Anesthesiologists (ASA) published guidelines recommending against routine preoperative laboratory testing for low-risk patients to reduce unnecessary medical expenditures. The aim of this study was to assess the change in routine preoperative laboratory testing in low-risk versus higher-risk patients before and after release of these guidelines. METHODS: The ACS-NSQIP database, 2005-2018, was separated into low-risk versus higher-risk patients based upon a previously published stratification. The guideline implementation date was defined as January 2013. Changes in preoperative laboratory testing over time were compared between low- and higher-risk patients. A difference-in-differences model was applied. The primary outcome included any laboratory test obtained ≤90 days prior to surgery. RESULTS: Of 7,507,991 patients, 972,431 (13.0%) were defined as low-risk and 6,535,560 (87.0%) higher-risk. Use of any preoperative laboratory test declined in low-risk patients from 66.5% before to 59.6% after guidelines, a 6.9 percentage point reduction, versus 93.0%-91.9% in higher-risk patients, a 1.1 percentage point reduction (p < 0.0001, comparing percentage point reductions). After risk-adjustment, the adjusted odds ratio for having any preoperative laboratory test after versus before the guidelines was 0.77 (95% CI 0.76-0.78) in low-risk versus 0.93 (0.92-0.94) in higher-risk patients. In low-risk patients, lack of any preoperative testing was not associated with worse outcomes. CONCLUSIONS: While a majority of low-risk patients continue to receive preoperative laboratory testing not recommended by the ASA, there has been a decline after implementation of guidelines. Continued effort should be directed at the deimplementation of routine preoperative laboratory testing for low-risk patients.

Statistical inference for diagnostic test accuracy studies with multiple comparisons.

Diagnostic accuracy studies assess the sensitivity and specificity of a new index test in relation to an established comparator or the reference standard. The development and selection of the index test are usually assumed to be conducted prior to the accuracy study. In practice, this is often violated, for instance, if the choice of the (apparently) best biomarker, model or cutpoint is based on the same data that is used later for validation purposes. In this work, we investigate several multiple comparison procedures which provide family-wise error rate control for the emerging multiple testing problem. Due to the nature of the co-primary hypothesis problem, conventional approaches for multiplicity adjustment are too conservative for the specific problem and thus need to be adapted. In an extensive simulation study, five multiple comparison procedures are compared with regard to statistical error rates in least-favourable and realistic scenarios. This covers parametric and non-parametric methods and one Bayesian approach. All methods have been implemented in the new open-source R package cases which allows us to reproduce all simulation results. Based on our numerical results, we conclude that the parametric approaches (maxT and Bonferroni) are easy to apply but can have inflated type I error rates for small sample sizes. The two investigated Bootstrap procedures, in particular the so-called pairs Bootstrap, allow for a family-wise error rate control in finite samples and in addition have a competitive statistical power.

Interval estimation in three-class receiver operating characteristic analysis: A fairly general approach based on the empirical likelihood.

The empirical likelihood is a powerful nonparametric tool, that emulates its parametric counterpart-the parametric likelihood-preserving many of its large-sample properties. This article tackles the problem of assessing the discriminatory power of three-class diagnostic tests from an empirical likelihood perspective. In particular, we concentrate on interval estimation in a three-class receiver operating characteristic analysis, where a variety of inferential tasks could be of interest. We present novel theoretical results and tailored techniques studied to efficiently solve some of such tasks. Extensive simulation experiments are provided in a supporting role, with our novel proposals compared to existing competitors, when possible. It emerges that our new proposals are extremely flexible, being able to compete with contestants and appearing suited to accommodating several distributions, such, for example, mixtures, for target populations. We illustrate the application of the novel proposals with a real data example. The article ends with a discussion and a presentation of some directions for future research.

Evaluation of Malaria Rapid Diagnostic Test Performance and pfhrp2 Deletion in Tanzania School Surveys, 2017.

As part of malaria nationwide monitoring and evaluation initiatives, there is an increasing trend of incorporating malaria rapid diagnostic tests (mRDTs) in surveys conducted within primary schools to detect malaria parasites. However, mRDTs based on the detection of histidine-rich protein 2 (HRP2) are known to yield false-positive results due to persistent antigenemia, and false-negative results may result from low parasitemia or Plasmodium falciparum hrp2/3 gene deletion. We evaluated diagnostic performance of an HRP2 and pan-parasite lactate dehydrogenase (HRP2/pLDH) mRDT against polymerase chain reaction (PCR) for detection of P. falciparum among 17,051 primary school-age children from eight regions of Tanzania in 2017. According to PCR, the prevalence of P. falciparum was 19.2% (95% CI: 18.6-19.8). Using PCR as reference, the sensitivity and specificity of mRDT was 76.2% (95% CI: 74.7-77.7) and 93.9% (95% CI: 93.5-94.3), respectively. Test agreement was lowest in low transmission areas, where true-positive mRDTs were outnumbered by false-negatives due to low parasitemia. Discordant samples (mRDT-negative but PCR-positive) were screened for pfhrp2/3 deletion by real-time PCR. Among those with a parasite density sufficient for analysis, pfhrp2 deletion was confirmed in 60 samples, whereas pfhrp3 deletion was confirmed in two samples; one sample had both pfhrp2 and pfhrp3 deletions. The majority of samples with gene deletions were detected in the high-transmission Kagera region. Compared with mRDTs, PCR and other molecular methods offer increased sensitivity and are not affected by pfhrp2/3 deletions, making them a useful supplement to mRDTs in schools and other epidemiological surveys.

Analysis of diagnostic test outcomes in a large loiasis cohort from an endemic region: Serological tests are often false negative in hyper-microfilaremic infections.

BACKGROUND: The parasitic disease loiasis is associated with significant morbidity and mortality. Individuals with hyper-microfilaremia (greater than 20,000 microfilariae per mL of blood) may suffer from serious treatment-related or spontaneous adverse events. Diagnosing loiasis remains complex and primarily relies on direct parasite detection. In this study, we analyzed the performance of various diagnostic tests and the influence of parasitological and clinical factors on test outcomes in samples from individuals living in an endemic region. METHODS: Data and samples were collected from rural Gabon. Loiasis was defined as either detectable microfilaremia, or a positive history of eyeworm as assessed by the RAPLOA questionnaire. Diagnostic testing included a quantitative PCR (qPCR) for detection of Loa loa DNA in blood samples, an in-house crude L. loa antigen IgG ELISA, and a rapid test for antibodies against the Ll-SXP-1 antigen (RDT). Sensitivity and specificity were determined for each test and factors potentially influencing outcomes were evaluated in an exploratory analysis. RESULTS: ELISA, RDT and qPCR results were available for 99.8%, 78.5%, and 100% of the 1,232 participants, respectively. The ELISA and RDT had only modest diagnostic accuracy. qPCR was specific for L. loa microfilaremia and Cycle threshold values correlated with microfilarial density. Anti-L. loa IgG levels were highest in occult loiasis, and antibody levels correlated inversely with L. loa microfilarial density as did RDT line intensities. Only 84.6% and 16.7% of hyper-microfilaremic individuals tested positive by ELISA (11/13) and RDT (2/12), respectively. CONCLUSION: None of the tests demonstrated high sensitivity and specificity for loiasis. Indirect diagnostic assays were characterized by low specificity. Additionally, hyper-microfilaremic individuals often tested negative by RDT and ELISA, indicating that these tests are not suitable for individual case management in endemic populations.

Use of a health worker-targeted smartphone app to support quality malaria RDT implementation in Busia County, Kenya: A feasibility and acceptability study.

Malaria rapid diagnostic tests (mRDTs) are an essential diagnostic tool in low-resource settings; however, administration and interpretation errors reduce their effectiveness. HealthPulse, a smartphone mRDT reader application, was developed by Audere to aid health workers in mRDT administration and interpretation, with an aim to improve the mRDT testing process and facilitate timely decision making through access to digitized results. Audere partnered with PSI and PS Kenya to conduct a pilot study in Busia County, Kenya between March and September 2021 to assess the feasibility and acceptability of HealthPulse to support malaria parasitological diagnosis by community health volunteers (CHVs) and private clinic health workers (private clinic HWs). Metadata was interpreted to assess adherence to correct use protocols and health worker perceptions of the app. Changes to mRDT implementation knowledge were measured through baseline and endline surveys. The baseline survey identified clear mRDT implementation gaps, such as few health workers correctly knowing the number of diluent drops and minimum and maximum wait times for mRDT interpretation, although health worker knowledge improved after using the app. Endline survey results showed that 99.6% of health workers found the app useful and 90.1% found the app easy to use. Process control data showed that most mRDTs (89.2%) were photographed within the recommended 30-minute time frame and that 91.4% of uploaded photos passed the app filter quality check on the first submission. During 154 encounters (3.5% of all encounters) a health worker dispensed an artemisinin-based combination therapy (ACT) to their patient even with a negative mRDT readout. Overall, study results indicated that HealthPulse holds potential as a mobile tool for use in low-resource settings, with future supportive supervision, diagnostic, and surveillance benefits. Follow-up studies will aim to more deeply understand the utility and acceptance of the HealthPulse app.